2025-07-13 00:53:07,665 [ 51280 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-07-13 00:53:07,665 [ 51280 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2025-07-13 00:53:07,665 [ 51280 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2025-07-13 00:53:07,665 [ 51280 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_e0k6d8 --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_database_delta/test.py::test_complex_table_schema test_catboost_evaluate/test.py::testAmazonModelManyRows test_distributed_format/test.py::test_remove_replica test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_access_control_on_cluster/test.py::test_access_control_on_cluster test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_config_decryption/test_wrong_settings.py::test_invalid_chars test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] [gw7] [ 1%] PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key [gw6] [ 2%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw3] [ 3%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] [gw8] [ 4%] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster [gw7] [ 5%] PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes [gw6] [ 6%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management [gw8] [ 7%] PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml [gw6] [ 8%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw6] [ 9%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection [gw8] [ 10%] PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies [gw3] [ 11%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] [gw0] [ 12%] PASSED test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow [gw0] [ 13%] PASSED test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString [gw1] [ 14%] PASSED test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration [gw1] [ 15%] PASSED test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas [gw0] [ 16%] PASSED test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures [gw6] [ 17%] PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies test_default_compression_codec/test.py::test_default_codec_for_compact_parts [gw0] [ 18%] PASSED test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric [gw1] [ 19%] PASSED test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query [gw0] [ 20%] PASSED test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath [gw0] [ 21%] PASSED test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath [gw0] [ 22%] PASSED test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString [gw7] [ 23%] PASSED test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] [gw3] [ 24%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] [gw0] [ 25%] PASSED test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate [gw0] [ 26%] PASSED test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures [gw0] [ 27%] PASSED test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures [gw0] [ 28%] PASSED test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures [gw8] [ 29%] PASSED test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple [gw3] [ 30%] PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] [gw0] [ 31%] PASSED test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash [gw4] [ 32%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes [gw1] [ 33%] PASSED test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node [gw7] [ 34%] PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method test_dictionaries_dependency_xml/test.py::test_dependent_tables [gw1] [ 35%] PASSED test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl [gw5] [ 36%] PASSED test_distributed_format/test.py::test_remove_replica test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] [gw8] [ 37%] PASSED test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single [gw1] [ 38%] PASSED test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load [gw1] [ 39%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key [gw1] [ 40%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key [gw1] [ 41%] PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema [gw2] [ 42%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] [gw1] [ 43%] PASSED test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration [gw1] [ 44%] PASSED test_dictionaries_postgresql/test.py::test_predefined_connection_configuration [gw3] [ 45%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] [gw0] [ 46%] PASSED test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh [gw6] [ 47%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] test_create_query_constraints/test.py::test_create_query_const_constraints [gw6] [ 48%] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] [gw0] [ 49%] PASSED test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments [gw0] [ 50%] PASSED test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_backup_restore_keeper_map/test.py::test_on_cluster[0] [gw3] [ 51%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] [gw7] [ 52%] PASSED test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data [gw5] [ 53%] PASSED test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] [gw4] [ 54%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] [gw1] [ 55%] PASSED test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw8] [ 56%] PASSED test_default_compression_codec/test.py::test_default_codec_single [gw1] [ 57%] PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints [gw5] [ 58%] PASSED test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] [gw3] [ 59%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] test_alter_settings_on_cluster/test.py::test_default_database_on_cluster [gw7] [ 60%] PASSED test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_backward_compatibility/test_functions.py::test_aggregate_states [gw2] [ 61%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] [gw0] [ 62%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw3] [ 63%] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] [gw5] [ 64%] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] [gw7] [ 65%] PASSED test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication [gw1] [ 66%] PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw6] [ 67%] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[0] test_backup_restore_keeper_map/test.py::test_on_cluster[1] [gw5] [ 68%] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] [gw2] [ 69%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] [gw5] [ 70%] PASSED test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] [gw0] [ 71%] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] [gw2] [ 72%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] [gw3] [ 73%] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields [gw6] [ 74%] PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[1] test_async_insert_memory/test.py::test_memory_usage test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_always_fetch_merged/test.py::test_replica_always_download [gw5] [ 75%] PASSED test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] [gw3] [ 76%] PASSED test_broken_part_during_merge/test.py::test_merge_and_part_corruption [gw0] [ 77%] PASSED test_always_fetch_merged/test.py::test_replica_always_download [gw4] [ 78%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] [gw2] [ 79%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_distributed_default_database/test.py::test_query [gw0] [ 80%] PASSED test_distributed_default_database/test.py::test_query [gw6] [ 81%] PASSED test_async_insert_memory/test.py::test_memory_usage [gw2] [ 82%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] [gw2] [ 83%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw4] [ 84%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] [gw2] [ 85%] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] [gw8] [ 86%] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions [gw8] [ 87%] SKIPPED test_backward_compatibility/test_functions.py::test_string_functions test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts [gw8] [ 88%] PASSED test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts [gw4] [ 89%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] [gw7] [ 90%] PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication test_config_yaml_full/test.py::test_yaml_full_conf [gw7] [ 91%] PASSED test_config_yaml_full/test.py::test_yaml_full_conf [gw4] [ 92%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] [gw4] [ 93%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup [gw4] [ 94%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw4] [ 95%] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw1] [ 96%] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_config_corresponding_root/test.py::test_work [gw1] [ 97%] PASSED test_config_corresponding_root/test.py::test_work [gw9] [ 98%] ERROR test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables [gw9] [ 99%] ERROR test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables [gw9] [100%] ERROR test_database_delta/test.py::test_multiple_schemes_tables ==================================== ERRORS ==================================== _________________ ERROR at setup of test_complex_table_schema __________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 5012 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ~~~~~~~~~~~~~~~~~~~~~ Stack of (139773048063552) ~~~~~~~~~~~~~~~~~~~~~ File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 411, in _perform_spawn reply.run() File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 341, in run self._result = func(*args, **kwargs) File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 1160, in _thread_receiver msg = Message.from_io(io) File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 567, in from_io header = io.read(9) # type 1, channel 4, payload 4 File "/usr/local/lib/python3.10/dist-packages/execnet/gateway_base.py", line 534, in read data = self._read(numbytes - len(buf)) ---------------------------- Captured stderr setup ----------------------------- Command:[docker ps | wc -l] Stdout:1 No running containers Pruning Docker networks Command:[docker network prune --force] Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 5023e731d952 ENV SHLVL 0 ENV HOME /root ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 5ccda723c1fc ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 ENV PYTEST_XDIST_TESTRUNUID 3d257bd6762b4211b749d1a7ff98e7eb ENV PYTEST_XDIST_WORKER gw9 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_database_delta/test.py::test_complex_table_schema (setup) CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestdatabasedelta-gw9. Added instance name:node1 tag:latest base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Running tests in /ClickHouse/tests/integration/test_database_delta/test.py Cluster start called. is_up=False Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for common tests configuration Copy common configuration from helpers Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/database Setup logs dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] Failed to start cluster: Timeout >900.0s Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 132, in run_and_check res = subprocess.run( File "/usr/lib/python3.10/subprocess.py", line 505, in run stdout, stderr = process.communicate(input, timeout=timeout) File "/usr/lib/python3.10/subprocess.py", line 1154, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/usr/lib/python3.10/subprocess.py", line 2021, in _communicate ready = selector.select(timeout) File "/usr/lib/python3.10/selectors.py", line 416, in select fd_event_list = self._selector.poll(timeout) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 313, in handler timeout_sigalrm(item, settings) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 498, in timeout_sigalrm pytest.fail("Timeout >%ss" % settings.timeout) File "/usr/local/lib/python3.10/dist-packages/_pytest/outcomes.py", line 198, in fail raise Failed(msg=reason, pytrace=pytrace) Failed: Timeout >900.0s docker compose up was not called. Trying to export docker.log for running containers Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 docker compose up was not called. Trying to export docker.log for running containers Cleanup called Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottestdatabasedelta-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:1 Volumes pruned: 1 ------------------------------ Captured log setup ------------------------------ 2025-07-13 00:53:13 [ 784 ] DEBUG : Command:[docker ps | wc -l] (cluster.py:121, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2025-07-13 00:53:14 [ 784 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2025-07-13 00:53:14 [ 784 ] DEBUG : Command:[docker network prune --force] (cluster.py:121, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Command:[sysctl net.ipv4.ip_local_port_range='55000 65535'] (cluster.py:121, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:145, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV HOSTNAME 5023e731d952 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV SHLVL 0 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV HOME /root (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV OLDPWD / (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG d862517635bf (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV TZ Etc/UTC (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV DOCKER_BASE_TAG 5ccda723c1fc (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 3d257bd6762b4211b749d1a7ff98e7eb (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PYTEST_XDIST_WORKER gw9 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : ENV PYTEST_CURRENT_TEST test_database_delta/test.py::test_complex_table_schema (setup) (cluster.py:419, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:719, __init__) 2025-07-13 00:53:14 [ 784 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1656, add_instance) 2025-07-13 00:53:14 [ 784 ] DEBUG : Cluster name: project_name:roottestdatabasedelta-gw9. Added instance name:node1 tag:latest base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1942, add_instance) 2025-07-13 00:53:14 [ 784 ] INFO : Starting cluster... (test.py:42, started_cluster) 2025-07-13 00:53:14 [ 784 ] INFO : Running tests in /ClickHouse/tests/integration/test_database_delta/test.py (cluster.py:2672, start) 2025-07-13 00:53:14 [ 784 ] DEBUG : Cluster start called. is_up=False (cluster.py:2679, start) 2025-07-13 00:53:14 [ 784 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 00:53:14 [ 784 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 00:53:14 [ 784 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 00:53:14 [ 784 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 00:53:14 [ 784 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 00:53:14 [ 784 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 00:53:14 [ 784 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 00:53:14 [ 784 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-13 00:53:14 [ 784 ] DEBUG : Setup directory for instance: node1 (cluster.py:2692, start) 2025-07-13 00:53:14 [ 784 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4536, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Create directory for common tests configuration (cluster.py:4541, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Copy common configuration from helpers (cluster.py:4561, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Generate and write macros file (cluster.py:4613, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/configs/config.d (cluster.py:4649, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/database (cluster.py:4666, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/logs (cluster.py:4677, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4758, create_dir) 2025-07-13 00:53:14 [ 784 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env (cluster.py:96, _create_env_file) 2025-07-13 00:53:14 [ 784 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-13 00:53:14 [ 784 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-13 00:53:14 [ 784 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-07-13 00:53:14 [ 784 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-07-13 00:53:14 [ 784 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-07-13 00:53:14 [ 784 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 00:58:14 [ 784 ] INFO : Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds (cluster.py:2709, logging_pulling_images) 2025-07-13 00:58:16 [ 784 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:03:16 [ 784 ] INFO : Got exception pulling images: Command '['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env', '--project-name', 'roottestdatabasedelta-gw9', '--file', '/ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml', 'pull']' timed out after 300 seconds (cluster.py:2709, logging_pulling_images) 2025-07-13 01:03:18 [ 784 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/.env --project-name roottestdatabasedelta-gw9 --file /ClickHouse/tests/integration/test_database_delta/_instances-0-gw9/node1/docker-compose.yml pull] (cluster.py:121, run_and_check) 2025-07-13 01:08:14 [ 784 ] DEBUG : Failed to start cluster: (cluster.py:3091, start) 2025-07-13 01:08:14 [ 784 ] DEBUG : Timeout >900.0s (cluster.py:3092, start) 2025-07-13 01:08:14 [ 784 ] DEBUG : Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2713, in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 20, in inner func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 132, in run_and_check res = subprocess.run( File "/usr/lib/python3.10/subprocess.py", line 505, in run stdout, stderr = process.communicate(input, timeout=timeout) File "/usr/lib/python3.10/subprocess.py", line 1154, in communicate stdout, stderr = self._communicate(input, endtime, timeout) File "/usr/lib/python3.10/subprocess.py", line 2021, in _communicate ready = selector.select(timeout) File "/usr/lib/python3.10/selectors.py", line 416, in select fd_event_list = self._selector.poll(timeout) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 313, in handler timeout_sigalrm(item, settings) File "/usr/local/lib/python3.10/dist-packages/pytest_timeout.py", line 498, in timeout_sigalrm pytest.fail("Timeout >%ss" % settings.timeout) File "/usr/local/lib/python3.10/dist-packages/_pytest/outcomes.py", line 198, in fail raise Failed(msg=reason, pytrace=pytrace) Failed: Timeout >900.0s (cluster.py:3093, start) 2025-07-13 01:08:14 [ 784 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-13 01:08:14 [ 784 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:08:14 [ 784 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:08:14 [ 784 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:08:14 [ 784 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:08:14 [ 784 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:08:14 [ 784 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:08:14 [ 784 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:08:14 [ 784 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:08:14 [ 784 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:08:14 [ 784 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) 2025-07-13 01:08:15 [ 784 ] WARNING : docker compose up was not called. Trying to export docker.log for running containers (cluster.py:3174, shutdown) 2025-07-13 01:08:15 [ 784 ] DEBUG : Cleanup called (cluster.py:846, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Docker networks for project roottestdatabasedelta-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:825, print_all_docker_pieces) 2025-07-13 01:08:15 [ 784 ] DEBUG : Docker containers for project roottestdatabasedelta-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:833, print_all_docker_pieces) 2025-07-13 01:08:15 [ 784 ] DEBUG : Docker volumes for project roottestdatabasedelta-gw9 are DRIVER VOLUME NAME (cluster.py:841, print_all_docker_pieces) 2025-07-13 01:08:15 [ 784 ] DEBUG : Command:[docker container list --all --filter name='^/roottestdatabasedelta-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:121, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Unstopped containers: {} (cluster.py:860, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : No running containers for project: roottestdatabasedelta-gw9 (cluster.py:874, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Trying to prune unused networks... (cluster.py:880, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Trying to prune unused images... (cluster.py:896, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Command:[docker image prune -f] (cluster.py:121, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:145, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Images pruned (cluster.py:899, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Trying to prune unused volumes... (cluster.py:905, cleanup) 2025-07-13 01:08:15 [ 784 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:121, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Stdout:1 (cluster.py:145, run_and_check) 2025-07-13 01:08:15 [ 784 ] DEBUG : Volumes pruned: 1 (cluster.py:910, cleanup) _____________ ERROR at setup of test_embedded_database_and_tables ______________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 5012 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ________________ ERROR at setup of test_multiple_schemes_tables ________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "node1", main_configs=[], user_configs=[], image="clickhouse/integration-test-with-unity-catalog", with_installed_binary=False, tag=os.environ.get("DOCKER_BASE_WITH_UNITY_CATALOG_TAG", "latest") ) logging.info("Starting cluster...") > cluster.start() test_database_delta/test.py:43: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2713: in start retry(log_function=logging_pulling_images)(run_and_check, images_pull_cmd) helpers/retry_decorator.py:20: in inner func(*args, **kwargs) helpers/cluster.py:132: in run_and_check res = subprocess.run( /usr/lib/python3.10/subprocess.py:505: in run stdout, stderr = process.communicate(input, timeout=timeout) /usr/lib/python3.10/subprocess.py:1154: in communicate stdout, stderr = self._communicate(input, endtime, timeout) /usr/lib/python3.10/subprocess.py:2021: in _communicate ready = selector.select(timeout) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = , timeout = 5012 def select(self, timeout=None): # This is shared between poll() and epoll(). # epoll() has a different signature and handling of timeout parameter. if timeout is None: timeout = None elif timeout <= 0: timeout = 0 else: # poll() has a resolution of 1 millisecond, round away from # zero to wait *at least* timeout seconds. timeout = math.ceil(timeout * 1e3) ready = [] try: > fd_event_list = self._selector.poll(timeout) E Failed: Timeout >900.0s /usr/lib/python3.10/selectors.py:416: Failed ----------------- generated report log file: parallel0_0.jsonl ----------------- ============================== slowest durations =============================== 901.19s setup test_database_delta/test.py::test_complex_table_schema 579.24s setup test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 302.37s setup test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 194.27s setup test_backward_compatibility/test_functions.py::test_aggregate_states 129.95s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 118.68s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 109.16s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 108.02s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 107.18s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 52.88s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 50.35s call test_async_insert_memory/test.py::test_memory_usage 41.91s call test_backup_restore_keeper_map/test.py::test_on_cluster[0] 41.33s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 40.19s call test_backward_compatibility/test_functions.py::test_aggregate_states 38.94s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 38.50s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 38.16s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 37.36s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 35.37s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 35.16s call test_backup_restore_keeper_map/test.py::test_on_cluster[1] 34.76s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 34.20s call test_distributed_format/test.py::test_remove_replica 33.71s call test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 32.82s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 32.07s call test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 31.97s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 31.85s call test_default_compression_codec/test.py::test_default_codec_single 27.85s call test_dictionaries_dependency_xml/test.py::test_get_data 26.62s call test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 24.48s setup test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 23.46s teardown test_default_compression_codec/test.py::test_default_codec_single 23.27s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 21.93s setup test_distributed_format/test.py::test_remove_replica 21.72s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 21.53s setup test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 21.44s setup test_catboost_evaluate/test.py::testAmazonModelManyRows 21.43s setup test_access_control_on_cluster/test.py::test_access_control_on_cluster 21.33s call test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 21.22s call test_distributed_default_database/test.py::test_query 21.18s call test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 20.98s call test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 20.91s call test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 19.79s teardown test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 19.50s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 19.07s setup test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 19.06s setup test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 18.81s call test_config_yaml_full/test.py::test_yaml_full_conf 17.82s setup test_broken_part_during_merge/test.py::test_merge_and_part_corruption 17.56s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 17.29s call test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 15.71s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 15.07s call test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 15.00s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 14.71s call test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 14.66s setup test_always_fetch_merged/test.py::test_replica_always_download 14.58s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 14.56s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 14.45s call test_config_decryption/test_wrong_settings.py::test_no_encryption_key 14.42s call test_dictionaries_postgresql/test.py::test_invalidate_query 14.20s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 14.11s setup test_backup_restore_keeper_map/test.py::test_on_cluster[0] 14.08s call test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 14.07s call test_catboost_evaluate/test.py::testAmazonModelManyRows 14.03s call test_catboost_evaluate/test.py::testRecoveryAfterCrash 13.87s call test_config_decryption/test_wrong_settings.py::test_subnodes 13.84s setup test_dictionaries_dependency_xml/test.py::test_dependent_tables 13.60s call test_dictionaries_dependency_xml/test.py::test_dependent_tables 13.59s call test_config_decryption/test_wrong_settings.py::test_invalid_chars 13.28s teardown test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 13.10s setup test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 13.05s setup test_create_query_constraints/test.py::test_create_query_const_constraints 12.74s setup test_async_insert_memory/test.py::test_memory_usage 12.73s call test_config_decryption/test_wrong_settings.py::test_wrong_method 12.50s setup test_config_corresponding_root/test.py::test_work 12.48s call test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 11.71s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] 11.48s teardown test_create_query_constraints/test.py::test_create_query_minmax_constraints 10.92s call test_always_fetch_merged/test.py::test_replica_always_download 10.04s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 9.50s call test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 9.09s call test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 8.87s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 8.87s teardown test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 8.73s setup test_default_compression_codec/test.py::test_default_codec_for_compact_parts 8.67s call test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 8.41s call test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 8.10s call test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 8.03s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 7.85s teardown test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 7.72s call test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 7.69s call test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 7.10s call test_default_compression_codec/test.py::test_default_codec_multiple 6.85s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 6.17s teardown test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts 6.10s teardown test_always_fetch_merged/test.py::test_replica_always_download 6.07s teardown test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 5.67s call test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 5.56s teardown test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 5.47s teardown test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 5.45s teardown test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 5.37s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 5.27s call test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 5.18s teardown test_broken_part_during_merge/test.py::test_merge_and_part_corruption 4.99s call test_access_control_on_cluster/test.py::test_access_control_on_cluster 4.87s teardown test_async_insert_memory/test.py::test_memory_usage 4.76s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 4.37s teardown test_backward_compatibility/test_functions.py::test_string_functions 4.30s call test_create_query_constraints/test.py::test_create_query_minmax_constraints 4.13s call test_broken_part_during_merge/test.py::test_merge_and_part_corruption 4.08s teardown test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 3.87s call test_alter_settings_on_cluster/test.py::test_default_database_on_cluster 3.75s call test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 3.46s teardown test_backup_restore_keeper_map/test.py::test_on_cluster[1] 3.30s teardown test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 3.10s call test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 2.94s call test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 2.87s call test_catboost_evaluate/test.py::testOnNullableFeatures 2.77s call test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 2.70s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 2.61s call test_catboost_evaluate/test.py::testNonConstantFeatures 2.59s call test_dictionaries_postgresql/test.py::test_load_dictionaries 2.43s call test_create_query_constraints/test.py::test_create_query_const_constraints 2.40s call test_default_compression_codec/test.py::test_default_codec_for_compact_parts 1.97s call test_catboost_evaluate/test.py::testModelPathIsNotAConstString 1.90s call test_access_control_on_cluster/test.py::test_grant_all_on_cluster 1.56s call test_catboost_evaluate/test.py::testInvalidModelPath 1.52s call test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 1.51s teardown test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 1.36s call test_catboost_evaluate/test.py::testModelUpdate 1.36s call test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 1.33s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 1.22s call test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 1.08s call test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 1.07s call test_dictionaries_postgresql/test.py::test_postgres_schema 1.01s call test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 1.00s call test_catboost_evaluate/test.py::testInvalidLibraryPath 0.99s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.95s call test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.94s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.89s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.89s call test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.87s call test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.75s call test_catboost_evaluate/test.py::testConstantFeatures 0.73s teardown test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.71s call test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.70s call test_backward_compatibility/test_functions.py::test_string_functions 0.69s call test_dictionaries_postgresql/test.py::test_bad_configuration 0.69s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.69s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 0.68s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.64s teardown test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.64s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.61s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection 0.53s teardown test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.32s call test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.05s setup test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.01s teardown test_catboost_evaluate/test.py::testAmazonModelManyRows 0.01s teardown test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] 0.00s teardown test_backup_restore_keeper_map/test.py::test_on_cluster[0] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.00s setup test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s setup test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] 0.00s teardown test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 0.00s teardown test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] 0.00s teardown test_config_corresponding_root/test.py::test_work 0.00s teardown test_distributed_format/test.py::test_remove_replica 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.00s setup test_backup_restore_keeper_map/test.py::test_on_cluster[1] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s setup test_config_yaml_full/test.py::test_yaml_full_conf 0.00s teardown test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s setup test_dictionaries_dependency_xml/test.py::test_get_data 0.00s teardown test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s setup test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.00s setup test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.00s setup test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name 0.00s setup test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] 0.00s teardown test_backward_compatibility/test_functions.py::test_aggregate_states 0.00s setup test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.00s setup test_create_query_constraints/test.py::test_create_query_minmax_constraints 0.00s teardown test_dictionaries_dependency_xml/test.py::test_get_data 0.00s teardown test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s teardown test_dictionaries_dependency_xml/test.py::test_dependent_tables 0.00s teardown test_config_yaml_full/test.py::test_yaml_full_conf 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] 0.00s teardown test_distributed_default_database/test.py::test_query 0.00s setup test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.00s setup test_dictionaries_postgresql/test.py::test_bad_configuration 0.00s setup test_distributed_default_database/test.py::test_query 0.00s setup test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s teardown test_catboost_evaluate/test.py::testConstantFeatures 0.00s setup test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s setup test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster 0.00s teardown test_database_delta/test.py::test_complex_table_schema 0.00s teardown test_access_control_on_cluster/test.py::test_access_control_on_cluster 0.00s teardown test_catboost_evaluate/test.py::testOnNullableFeatures 0.00s teardown test_dictionaries_postgresql/test.py::test_invalidate_query 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] 0.00s setup test_config_decryption/test_wrong_settings.py::test_no_encryption_key 0.00s teardown test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] 0.00s setup test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] 0.00s teardown test_create_query_constraints/test.py::test_create_query_const_constraints 0.00s setup test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.00s teardown test_default_compression_codec/test.py::test_default_codec_for_compact_parts 0.00s setup test_catboost_evaluate/test.py::testRecoveryAfterCrash 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_introspection 0.00s teardown test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] 0.00s setup test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management 0.00s setup test_backward_compatibility/test_functions.py::test_string_functions 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.00s teardown test_default_compression_codec/test.py::test_default_codec_multiple 0.00s setup test_catboost_evaluate/test.py::testModelPathIsNotAConstString 0.00s setup test_dictionaries_postgresql/test.py::test_load_dictionaries 0.00s setup test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s teardown test_catboost_evaluate/test.py::testNonConstantFeatures 0.00s call test_config_corresponding_root/test.py::test_work 0.00s setup test_default_compression_codec/test.py::test_default_codec_single 0.00s setup test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.00s setup test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] 0.00s teardown test_database_delta/test.py::test_multiple_schemes_tables 0.00s setup test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.00s setup test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] 0.00s setup test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] 0.00s teardown test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] 0.00s setup test_catboost_evaluate/test.py::testInvalidModelPath 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_schema 0.00s teardown test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s teardown test_config_decryption/test_wrong_settings.py::test_subnodes 0.00s setup test_catboost_evaluate/test.py::testModelUpdate 0.00s setup test_config_decryption/test_wrong_settings.py::test_wrong_method 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key 0.00s setup test_catboost_evaluate/test.py::testOnNullableFeatures 0.00s teardown test_catboost_evaluate/test.py::testInvalidLibraryPath 0.00s teardown test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] 0.00s setup test_catboost_evaluate/test.py::testInvalidLibraryPath 0.00s teardown test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] 0.00s teardown test_catboost_evaluate/test.py::testModelUpdate 0.00s teardown test_catboost_evaluate/test.py::testInvalidModelPath 0.00s setup test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key 0.00s setup test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 0.00s setup test_catboost_evaluate/test.py::testNonConstantFeatures 0.00s setup test_catboost_evaluate/test.py::testConstantFeatures 0.00s teardown test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh 0.00s setup test_dictionaries_postgresql/test.py::test_predefined_connection_configuration 0.00s teardown test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric 0.00s setup test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 0.00s setup test_dictionaries_postgresql/test.py::test_invalidate_query 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load 0.00s teardown test_dictionaries_postgresql/test.py::test_postgres_schema 0.00s teardown test_dictionaries_postgresql/test.py::test_load_dictionaries 0.00s teardown test_dictionaries_postgresql/test.py::test_bad_configuration 0.00s setup test_database_delta/test.py::test_multiple_schemes_tables 0.00s teardown test_database_delta/test.py::test_embedded_database_and_tables 0.00s setup test_default_compression_codec/test.py::test_default_codec_multiple 0.00s teardown test_dictionaries_postgresql/test.py::test_dictionary_with_replicas 0.00s setup test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString 0.00s teardown test_dictionaries_postgresql/test.py::test_named_collection_from_ddl 0.00s teardown test_config_decryption/test_wrong_settings.py::test_invalid_chars 0.00s teardown test_catboost_evaluate/test.py::testRecoveryAfterCrash 0.00s setup test_database_delta/test.py::test_embedded_database_and_tables 0.00s teardown test_access_control_on_cluster/test.py::test_grant_all_on_cluster 0.00s teardown test_catboost_evaluate/test.py::testModelPathIsNotAConstString 0.00s teardown test_catboost_evaluate/test.py::testOnLowCardinalityFeatures 0.00s teardown test_catboost_evaluate/test.py::testAmazonModelSingleRow 0.00s teardown test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] =========================== short test summary info ============================ ERROR test_database_delta/test.py::test_complex_table_schema - Failed: Timeou... ERROR test_database_delta/test.py::test_embedded_database_and_tables - Failed... ERROR test_database_delta/test.py::test_multiple_schemes_tables - Failed: Tim... PASSED test_config_decryption/test_wrong_settings.py::test_invalid_chars PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part] PASSED test_access_control_on_cluster/test.py::test_access_control_on_cluster PASSED test_config_decryption/test_wrong_settings.py::test_no_encryption_key PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management PASSED test_access_control_on_cluster/test.py::test_grant_all_on_cluster PASSED test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml PASSED test_disabled_access_control_improvements/test_row_policy.py::test_introspection PASSED test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table] PASSED test_catboost_evaluate/test.py::testAmazonModelManyRows PASSED test_catboost_evaluate/test.py::testAmazonModelSingleRow PASSED test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect PASSED test_dictionaries_postgresql/test.py::test_bad_configuration PASSED test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString PASSED test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies PASSED test_catboost_evaluate/test.py::testConstantFeatures PASSED test_dictionaries_postgresql/test.py::test_dictionary_with_replicas PASSED test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric PASSED test_catboost_evaluate/test.py::testInvalidLibraryPath PASSED test_catboost_evaluate/test.py::testInvalidModelPath PASSED test_config_decryption/test_wrong_settings.py::test_subnodes PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part] PASSED test_catboost_evaluate/test.py::testModelPathIsNotAConstString PASSED test_catboost_evaluate/test.py::testModelUpdate PASSED test_catboost_evaluate/test.py::testNonConstantFeatures PASSED test_catboost_evaluate/test.py::testOnLowCardinalityFeatures PASSED test_default_compression_codec/test.py::test_default_codec_for_compact_parts PASSED test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate] PASSED test_catboost_evaluate/test.py::testOnNullableFeatures PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes PASSED test_dictionaries_postgresql/test.py::test_invalidate_query PASSED test_config_decryption/test_wrong_settings.py::test_wrong_method PASSED test_dictionaries_postgresql/test.py::test_load_dictionaries PASSED test_distributed_format/test.py::test_remove_replica PASSED test_default_compression_codec/test.py::test_default_codec_multiple PASSED test_dictionaries_postgresql/test.py::test_named_collection_from_ddl PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key PASSED test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache] PASSED test_dictionaries_postgresql/test.py::test_postgres_schema PASSED test_dictionaries_postgresql/test.py::test_predefined_connection_configuration PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx] PASSED test_catboost_evaluate/test.py::testRecoveryAfterCrash PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic] PASSED test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary] PASSED test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh PASSED test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit] PASSED test_dictionaries_dependency_xml/test.py::test_dependent_tables PASSED test_distributed_format/test.py::test_single_file[test_cluster_internal_replication] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node PASSED test_create_query_constraints/test.py::test_create_query_const_constraints PASSED test_default_compression_codec/test.py::test_default_codec_single PASSED test_create_query_constraints/test.py::test_create_query_minmax_constraints PASSED test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished] PASSED test_dictionaries_dependency_xml/test.py::test_get_data PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs] PASSED test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication] PASSED test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name PASSED test_alter_settings_on_cluster/test.py::test_default_database_on_cluster PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[0] PASSED test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed] PASSED test_distributed_format/test.py::test_two_files[test_cluster_internal_replication] PASSED test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields PASSED test_backup_restore_keeper_map/test.py::test_on_cluster[1] PASSED test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication] PASSED test_broken_part_during_merge/test.py::test_merge_and_part_corruption PASSED test_always_fetch_merged/test.py::test_replica_always_download PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache] PASSED test_distributed_default_database/test.py::test_query PASSED test_async_insert_memory/test.py::test_memory_usage PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] PASSED test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed] PASSED test_backward_compatibility/test_functions.py::test_aggregate_states PASSED test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] PASSED test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication PASSED test_config_yaml_full/test.py::test_yaml_full_conf PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability PASSED test_config_corresponding_root/test.py::test_work SKIPPED [1] test_backward_compatibility/test_functions.py:164: The test is slow in builds with sanitizer ============= 96 passed, 1 skipped, 3 errors in 904.63s (0:15:04) ============== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_e0k6d8 --privileged --dns-search='.' --memory=30709026816 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel0_0.jsonl --report-log-exclude-logs-on-passed-tests test_access_control_on_cluster/test.py::test_access_control_on_cluster test_access_control_on_cluster/test.py::test_grant_all_on_cluster test_access_control_on_cluster/test.py::test_grant_current_database_on_cluster test_alter_settings_on_cluster/test.py::test_default_database_on_cluster test_always_fetch_merged/test.py::test_replica_always_download test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Atomic]' 'test_attach_partition_with_large_destination/test.py::test_attach_partition_with_large_destination[Ordinary]' test_azure_blob_storage_zero_copy_replication/test.py::test_zero_copy_replication 'test_backup_restore_keeper_map/test.py::test_on_cluster[0]' 'test_backup_restore_keeper_map/test.py::test_on_cluster[1]' test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backward_compatibility/test_functions.py::test_aggregate_states test_backward_compatibility/test_functions.py::test_string_functions test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_broken_part_during_merge/test.py::test_merge_and_part_corruption test_catboost_evaluate/test.py::testAmazonModelManyRows test_catboost_evaluate/test.py::testAmazonModelSingleRow test_catboost_evaluate/test.py::testCategoricalFeatureMustBeNumericOrString test_catboost_evaluate/test.py::testConstantFeatures test_catboost_evaluate/test.py::testFloatFeatureMustBeNumeric test_catboost_evaluate/test.py::testInvalidLibraryPath test_catboost_evaluate/test.py::testInvalidModelPath test_catboost_evaluate/test.py::testModelPathIsNotAConstString test_catboost_evaluate/test.py::testModelUpdate test_catboost_evaluate/test.py::testNonConstantFeatures test_catboost_evaluate/test.py::testOnLowCardinalityFeatures test_catboost_evaluate/test.py::testOnNullableFeatures test_catboost_evaluate/test.py::testRecoveryAfterCrash test_catboost_evaluate/test.py::testSystemModelsAndModelRefresh test_catboost_evaluate/test.py::testWrongNumberOfFeatureArguments test_config_corresponding_root/test.py::test_work test_config_decryption/test_wrong_settings.py::test_invalid_chars test_config_decryption/test_wrong_settings.py::test_no_encryption_key test_config_decryption/test_wrong_settings.py::test_subnodes test_config_decryption/test_wrong_settings.py::test_wrong_method test_config_yaml_full/test.py::test_yaml_full_conf test_create_query_constraints/test.py::test_create_query_const_constraints test_create_query_constraints/test.py::test_create_query_minmax_constraints test_database_delta/test.py::test_complex_table_schema test_database_delta/test.py::test_embedded_database_and_tables test_database_delta/test.py::test_multiple_schemes_tables test_ddl_on_cluster_stop_waiting_for_offline_hosts/test.py::test_stop_waiting_for_offline_hosts test_default_compression_codec/test.py::test_default_codec_for_compact_parts test_default_compression_codec/test.py::test_default_codec_multiple test_default_compression_codec/test.py::test_default_codec_single 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_complex[complex_key_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_ranged[range_hashed]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[cache]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[direct]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[flat]' 'test_dictionaries_all_layouts_separate_sources/test_clickhouse_remote.py::test_simple[hashed]' test_dictionaries_dependency_xml/test.py::test_dependent_tables test_dictionaries_dependency_xml/test.py::test_get_data test_dictionaries_dependency_xml/test.py::test_xml_dict_same_name test_dictionaries_postgresql/test.py::test_background_dictionary_reconnect test_dictionaries_postgresql/test.py::test_bad_configuration test_dictionaries_postgresql/test.py::test_dictionary_with_replicas test_dictionaries_postgresql/test.py::test_invalidate_query test_dictionaries_postgresql/test.py::test_load_dictionaries test_dictionaries_postgresql/test.py::test_named_collection_from_ddl test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_full_load test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_complex_key test_dictionaries_postgresql/test.py::test_postgres_dictionaries_custom_query_partial_load_simple_key test_dictionaries_postgresql/test.py::test_postgres_schema test_dictionaries_postgresql/test.py::test_predefined_connection_configuration test_disabled_access_control_improvements/test_row_policy.py::test_dcl_introspection test_disabled_access_control_improvements/test_row_policy.py::test_dcl_management test_disabled_access_control_improvements/test_row_policy.py::test_dcl_users_with_policies_from_users_xml test_disabled_access_control_improvements/test_row_policy.py::test_introspection test_disabled_access_control_improvements/test_row_policy.py::test_some_users_without_policies 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs]' 'test_distributed_ddl/test_replicated_alter.py::test_replicated_alters[configs_secure]' test_distributed_default_database/test.py::test_query test_distributed_format/test.py::test_remove_replica 'test_distributed_format/test.py::test_single_file[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_single_file_old[test_cluster_no_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_internal_replication]' 'test_distributed_format/test.py::test_two_files[test_cluster_no_internal_replication]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[detach table]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[drop part]' 'test_drop_is_lock_free/test.py::test_query_is_lock_free[truncate]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-NoTx]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxCommit]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxNotFinished]' 'test_drop_is_lock_free/test.py::test_query_is_permanent[detach-part-TxRollback]' -vvv " altinityinfra/integration-tests-runner:ad96270260ff ' returned non-zero exit status 1.